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f 1STTNG OF T fftt CLAIMS 

Claims 1-42 were originally pending. Please amend claims 2, 4-7, 10-11, 
14-15, 18-20, 22-24, 26-27, 30-32, 36, and 3940. Please cancel claims 1, 3, 12, 
13, 21, 25, 33-35, 37-38, and 41-42 without prejudice. No claims are added. 
Accordingly, 2, 4-11, 14-20, 22-24, 26-32, 36, and 39-40 remain pending. The 
following listing of claims replaces all prior versions, and listings of claims in the 
application. 




1. (Canceled). 



2. (Currently amended) A method as recited in claim 5J-, wherein the 
operation of estimating head motion further comprises: 

calculating an estimation objective function comprising a set of terms to 
estimate: (a) each of the set of physical face parameters, (b) a first head pose 
transform corresponding to the first image, and (c) a second head pose transform 
corresponding to the second image. 



3. (Canceled). 
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4. (Currently amended) A method as recited in claim 5>,: 
wherein the particular face parameter corresponds to the nose tip; and 
wherein the predetermined nnnimum value is zero (0) and the 

predetermined maximum value is a reasonable value based on absolute values of 

other of the locations. 

5. (Currently amended) A method u- luu lu d in claim \ t o estimate head , 
r , ift n between t ™ *" f™ " f * face - " Hh ^ operations of : 

[f1rntif| ,, r i ^nn. of a morality of distinct facial features in the twp. 
w». p~ the ^ ^nding - - imfcnowiw determined upon 

^ nf h e^ ^ the number of unknowns hriny dHrrmined by a 

number of eq uations; 

n^rr^ F H, a identified in^tinm into a set of physical face parameters 
KggpH nn the sv— "f distinct facial features, the set of physical face 
rasters red» ™ r number of unknowns as compared to the numbej pf 

^.rfiww used to dete ""«"* fo e unknowns: 

m ineq uality c ™«*"W,t nn a particular face parameter of the 
rK ynrj.1 face r -^. such tW th. particular fare parameter is constrained 
™th™ „ predetermined minimum and maximum value; 

further comprising converting the inequality constraint to an equality 
constraint using a penalty functioniand 

^timatina head motinn from iden t ified points in the two images, the 
{Amrifi«H pnints being ba^ d nn the set of physical face parameters, 
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6 (Currently amended) A method asnFeeitedHfrelaim-hJS-^SilS 8 ^^^ 
.r^effieer^I^^ 

fca^fc^^^ 
e,tin J atio S _ f JJ ! ^^ 
n 1im v.f>r nf Rquations; 

fe^sLcMjhe^vmm^^^ 

i untjyn- - T -ri1 1" «" "nknflrYlts; an4 

u|||U|j||||J|LJ|1 m - f „ ^ M^w, ,1 nnintn in tV tyyo InHM. ft. 

juUiOumnlMl i Drirr ~ *■ - " f ^ """"""^ 

hereto me operation of estimating head motion cxfflHis^tatta 

oompriGW operations of: 

calculating an estimation objective function to determine an initial 
estima* of head rotation, the estimation objective taction comprising a set of 
Krms to estimate: (a) each of the set of physical face parameters, (b) a first head 

♦« the first imaKe, and (c) a second head pose 
pose transform corresponding to the iirsx image, *u v / 

transform corresponding to the second image; 

placing an inequality constraint on a particular face parameter of the 
set of physical face parameters, such that the particular face parameter is 
constrained within a predetermined minimum and maximum value; 

converting the inequality constraint to an equality constraint using a 

penalty function; and 

adding the equality constraint to the initial estimate [estimation system]. 
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7 . (Currently amended) A method as recited in claim 5>, wherein the 
identified locations correspond to the eye corners, mouth comers and nose tip. 



8 (Original) A method as recited in claim 2, wherein in the operation of 
estimating me head motion further comprises an operation of multiplying each 
term of the estimation objective function by a weighted contribution factor based 
on the confidence of data corresponding to the estimation objective function. 

9. (Original) A method as recited in claim 5, wherein in the operation of 
providing further comprises operations of: 

multiplying each term of the estimation objective function and the equality 
constraint by a weighted contribution factor based on the confidence of data 
corresponding to the estimation objective function. 

10. (Currently amended) A method as recited in claim 5_4> wherein the 
identifying comprises accepting input from a human user. 

11. (Currently amended) A computer-readable medium storing 
computer-executable instructions that, when executed on a computer, pe^ms^e 
ui othod of Hnim 1 m ^P»nrd to perform operation* of ft* method of claim . L 

12. (Canceled). 

13. (Canceled). 
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, anded) One or more computer-readable media « 
«■ ^ ^JLe^^ 

BBSejsoLJ*-^*^^ 

^^irtiims comnrisinp ii>qtni^ ons fo ** images: 

^ flV> a first Msfonncnrrpspondinfi to 
f ak each of th» foramrtm, 1 h l fl nTSt 

. * a weighted contribution factor based 

tenn of the estimation objective function by a weign 

to the estimation objective function, 
on the confidence of data corresponding to the estimati 

One or more computer-readable media as 
15 (Currently amended) One or more v 

^ ™a >,efnre estimating, further comprising: 
recited m claim 14 43, after convertmg and before estrma g, 

and maximum value. 
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16 . (Original) One or more computer-readable media as recited in claim 



15 



hereto the predetermined minimum md *» P redet « milled 

^um «due ate based on absolute values of other of the locations. 

17. (Original) One « more computer-readable media as recited in claim 
,5, tamer comprising converting the inequality constraint to an equality 
constraint using a penalty function. 

18. (Currently amended) One or more computer-readable media as 
recited in claim 14JS, wherein the . uUu m Uii fc f ill.,! nnmpriro- n ati o n 

j J ]a J lM_Jhnrf- - ~* M ^ ! "" ,inn ** * * * * ** 

^ien-^ete^an initial estimate of image rotation, fee^Haatiei^bje^ 

Wi u u LUiupiinn c n uut u P ... Mimn t , . CaJ » u ul» n f I I... H ■■ im rt nr. (h) 

...u^ ,^ <w transform is a first pose transform corresponding to the first 

image, and & irhrHr — 15 a second ^ 
corresponding to the second image mrt whrrr-in nrtfaiflHnp further comprises* 

placing an inequaUty constraint on a particular parameter of the parameters, 
such that the particular parameter is constrained within a predetermined minimum 

and maximum value; 

converting the inequality constraint to an equality constraint using a penalty 

function; and 

adding the equality constraint to the initial estimate. 
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19. (Currently amended) One or more computer-readable media as 
recited in claim 18, wherein in d ie u aloulating A utho r Of X^ HS^multiplying 
fi^wcnmnmes muldnhritt J^ tu rn u fi l w p^mn H o u u u ju ufro fi inrtion nntl 
the equality constraint by a weighted contribution factor based on the confidence 
of data corresponding to the estimation objective function. 

20. (Currently amended) One or more computer-readable media as 
recited in claim 1443, wherein the ideatffyifig determiningLComprises accepting 
input from a human user. 

21. (Canceled). 

22. (Currently amended) A method as recited in claim 26_£± s wherein 
the identified locations correspond to the eye comers, mouth corners and nose tip. 

23. (Currently amended) A method as recited in claim 26_24-, wherein 
the identifying comprises accepting input from a human user. 

24. (Currently amended) A method as recited in claim 26_24-, further 
comprising multiplying the refined head motion estimate by a confidence factor 
that indicates that each of the identified locations was identified with a same level 
of accuracy. 

25. (Canceled). 
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26. (Currently amended) A method m i c utod in clai m tP_^timate 
y^A m ^ h^een two images of ^fljC T. the method comprising: 

Wntions of - pV T™" " f fflHfll " ** 

, fr - thr — ^ pnndto to * number of unknowns determined upon 

^^n^J^ m ^m tht> rnimhrr of unknowns bein g determined by a 

number of equations: 

th« locati ™* Sft t of physical face parameters based on the 

^ trifled di finrt fecial features the set of physical face 

^nations used ™ determine the unknowns; 
(£ A~-rini«* an initH ~fl f wion of head motion between the two image s 

« C in p the set of p h ysical face p arameters as follows: 

ft) calculating g" ^mfltion ob j^tive function comprising a number 

- f , Tr ^timate each f ) the .et of coordinates, (h) a first head pose 

oo^ pnndin g ^ thp first image and (o) a second head PP* transform , 
correspond in g to the s^ ond image: and 

(2*1 wh e r e in in t h e T""^ nT1 nf H " f " m " ning forte comprise 
^u Y r ^ ~n.h term ^ estimation objective function by a weighted 
factor base d n fl the confidence of data corresponding to th e 

estimation objective function; and 

^finin ff fre initial estimation of head motion bv incorporating the initial 

ftfttimation in*" » feature matching algorithm. 
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27 . (Current amended) A method as recited in claim *e 
converting and before the deteminir* further comprise*: 

^ „ h^uality constraint on a particular V— " *• 
^ peters, such that the p^neter is conned within a predetermined 
minimum and maximum value. 

2g, (Original) A method as recited in claim 27: 

serein the particular parameter corresponds to the nose tip; and 

herein the predetermined nunimum value is zero (0) and the 

VKMei maximum value is a reasonable value based on absolute values of 

other of the locations. 

29 (Original) A method as recited in claim 27, mrther comprising 
averting the meouaiitv constraint * an equality constraint using a penalty 

function. 
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30. (Currently amended) A method as recited in claim 26_2±> wherein 
the detennining further comprises: ^ 

uf. 0 0 t h o p h ys Waeu y a w** (b) n fl . >l u ca d p M n t nn ^ m 

tuii cflpondu^ m lit e 'iff m nrl i mnp p ; 

adding an inequality constraint on a particular parameter of the physical 
face parameters, such that the particular parameter is constrained within a 
predetermined minimum and maximum value; 

converting the inequality constraint to an equality constraint using a penalty 

function; and 

adding the equality constraint to the initial estimate. 

31. (Currently amended) A method as recited in claim 30, wherein in 
the operation of f*ev4di*g dele^mjn^further comprises operations of* 
multiplying o auli lum i u f t hn nn t imntio n o b j u tli v . fun rtinn the equality 
constraint by a weighted contribution factor based on the confidence of data 
corresponding to the estimation objective function. 

32. (Currently amended) A computer-readable medium storing 
computer-executable instructions that, when executed on a computer, pefft*ffls 
perform t he method of claim 26S4-- 

33. (Canceled). 



Page 12 of 17 MS1-684USM01 
PAGE 13/18 * RCVD AT «1 512004 6:57:07 PM [Eastern Daylight rime] * SVR:USPT0-EFXRF-1/1 * DH1S:8729306* CSID:3035390271 * DURATION (mm-ss):04-06 



P. 14/18 



JUN 15 2004 17:00 FR LEE PND HAYES -PLLC 3035390271 TO 1703872930S 

Appl. No. 09/731,481 

ReTponse to March 29, 2004 Office action 

34. (Canceled). 

35. (Canceled). 

36. (Currently amended) A me&ed n»-i cuil* J h cl ni n . n S°m£2& 

jlt^jLiiir-rim-tfr — ™ th^pmmi^^ comprising : 

a processor: and 

, m .nn pi^d to r r^- me mffllftrv computer ' 

pmrmr '-f™*"™ execute by the processor for: 
^ i-w^n p location ^ » of dMinCt fraT,ireS ™ ±& ^ 

<D u, r Wtions f-r ^ ^ *™mrrrir,1 shared between the 

ri n jTm r , corresponding to b number , of unknowns determined 

i jnn intimation motion bet»""»" two images: 

rm — thP incations i " ^ « «* of narameters based on the 
, ymr . ^ „f th, identified d ^~* the mnmrtrrs racing the numberof 

1in1lin ..^ , n nr r ~A m * number of emotions used to detmnine the unknown s; 

^rir^tin fr motion be t ™~n the two inwes wring the parameters by: 
m „ n wi«tin ff an estinv >rt™ nhiective fiinrtion comprising a number 
nf «„ ^ each o f- f ) ^ p^meters, fh> « first imaf* pose transform 

^^tn p m the first ™«™ imd f«* a Tconn inw* P™* transform 

<;oTTes pondm|> tn the se cond image; 

(2) whoroin in tho- operation of pi u viding further compriooo on 
eperato^-multiplying each term of the estimation objective function by a 
weighted contribution factor based on the confidence of that corresponding data; 
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providing initial estima te of image rotation hy estimatiqn of 
„ a .h Af the «« p ^ » first imar - transform corresponding to the first 
image, and a «~™d image n o** transform corresponding, to the second image; 

(41 adding an inequality constraint on a particular para meter of the 
^^h. m h «he r «*rri«n1«r parameter is constrained within a 

predetermined mipi mnm and mavimum value: 

ffl converti n g the inequality constrain t to an equality constraint 

nsin p a penalty func tion: and 

ffi) addin g the equality constraint to the in itial estimate. 

37. (Canceled). 

38. (Canceled). 



39. (Currently amended) A method as rocitod in oloim 31, furth e r 
comprising* to estimate motion between two images, the method comprising: 

M^nHfyir ^ locations of a plurality o f distinct features in the two images, the 
locations corresponding to symmetrical features sha red between the two images, 
the locations corresponding to a number of unknowns determined upon estimation 
o f motion between the two images: 

converting the locations into a set of parameters based on the symmetry of 
the identified distinct features, the par ameters reducing the number of unknowns 
as compared to a number of equations used to d etermine the unknowns: and 

estimatin g motion between the two images using the parameters bv: 
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pwwiHiti p an initial estimate of i maae rotation bv estimation of each 
nf the naramet™ » ^ imag e transform corresponding to the first image, 
and a second *™a pe nose tra n sform corresponding to the second image; 

multiplying each term of a set of terms used to determine the initial 
estimate by a weighted contribution factor based on the confidence of data 
corresponding to the initial estunatei 

adding an inequality constra int on a particular parameter of the 
parameters. «,.n that the particular parameter is constrained within a 
predetermined minimum and m aximum value: 

r^ v^ rtin g , the inequality constraint to an equality constraint using a 

penalt y function: and 

addin g the equality constraint to the i nitial estimate. 

40. (Currently amended) A computer-readable medium storing 
computer-executable instructions that, when executed on a computer, performs the 
method of claim 39 33. 



41. (Canceled). 

42. (Canceled). 
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